Nov 10
26

Google Published Detailed Specifications on Robots.txt

Webmasters and SEOs have new reading material for this weekend. Google has published a very comprehensive and detailed Robots.txt Specifications, Robots meta tag and X-Robots-Tag HTTP header specifications and how to control crawling and indexing by GoogleBot. There are two…

Read more:
Google Published Detailed Specifications on Robots.txt

Tags: ,

This entry was posted on 2010/11/26 at 1:28 pm. You can follow any responses to this entry through the RSS 2.0 feed. Responses are currently closed, but you can trackback from your own site.

Posted in SEO by admin No Comments Yet

Comments are closed.